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Abstract. We provide geometrical interpretation of the Master The- 
orem to solve divide-and-conquer recurrences. We show how different 

cases of the recurrences correspond to different kinds of fractal images. 
Fractal dimension and Hausdorff measure are shown to be closely related 
to the solution of such recurrences. 
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1 Introduction 

Divide-and-conquer recurrences often arise in computer science as 
many important problems can be solved using divide-and-conquer 
approach in which a problem is divided into smaller subproblems 
which are solved independently and then their results are processed 
and combined to give final results. A classic example of this divide- 
and-conquer approach is Fast Fourier Transform (FFT) in which a 
problem of size n is divided into two subproblems each of size n/2 
and results of which are combined in linear time. The divide-and- 
conquer recurrence for FFT is 

T(n) = 2T{n/2)+0{n) 

which has the solution T{n) — O(nlogn). 
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It has been well known how to solve such divide-and-conquer 
recurrences, see [3] for the Master Theorem, and its various general- 
izations as in [1, 5, 8]. 

In this paper, we present a new geometrical way of looking at 
the Master Theorem. We make use of Fractal Geometry which is 
mathematical study of self-similar objects [2,6]. It is natural to see 
the connection between fractals, which can be often created using a 
recursive subdivision process, and recursive algorithms such as FFT. 
For past related work, see [4] . However in this past work, the treat- 
ment of the subject and proofs of results are complex as one worked 
with infinite resolution images. It also lacks geometrical intuition 
and emphasis on the most common type of divide-and-conquer re- 
currences which are handled by the Master Theorem. 

This paper derives the results for such common recurrences in 
a simpler and expository manner. The primary difference in ap- 
proaches of this paper and of [4] is that we work with finite recursion 
trees and corresponding finite resolution images here to get the re- 
sults in a simpler manner. 

This link between fractals and the Master Theorem is remarkable 
as it gives simpler, intuitive understanding of the proof of the Master 
Theorem. Goal of this paper is to bridge this gap between divide-and- 
conquer algorithms and fractal geometry by providing this intuition 
to the reader. We geometrically illustrate each case of the Master 
Theorem and show how it is strongly related to the notions of Fractal 
dimension and Hausdorff measure. 

Our main idea is to construct an Iterated Function System (IFS) [2] 
consisting of contractive transformations where each transformation 
corresponds to a recursive call to solve a subproblem. The recursions 
of the algorithm correspond to the iterations of the IFS. The time 
complexity of the algorithm is determined by the number of leaves in 
the recursion tree, which is identical to the number of e-balls needed 
to cover the fractal image in the computation of the Fractal dimen- 
sion. The additional computation overhead of dividing the problem 
into subproblems and combining their results is also captured by a 
fractal image. 

We conclude the paper by showing how a theorem on Fractal 
dimension proved in [7] is closely related to the Master Theorem. 



Throughout the paper, we emphasize intuition by providing several 
examples which are illustrated in detail in figures. 

2 Preliminaries 

2.1 Mcister Theorem 

We state the Master Theorem. 

Let a > 1 and 6 > 1 be constants, let f{n) be a function and let 
T{n) be defined on the nonnegative integers by the recurrence 

Tin)^aTin/b) + fin), 

where we interpret n/b to mean either \n/b\ or fn/fe]. Then T{n) 
can be bounded asymptotically as follows. 

1. If /(n) = 0{n}°^'"i-') for some constant e > 0, then T{n) = 

2. If /(n) = 6'(n'°S'''*), then T(n) = 0(n^°S'''^logn). 

3. If /(n) = f2{n^°^''"'^^) for some constant e > 0, and if af{n/b) < 
cf{n) for some constant c < 1 and all sufficiently large n, then 
T{n)^0{f{n)). 

For proof, see [3] . The three cases are needed as one has to con- 
sider if the overhead term f{n) dominates the computation or the 
recursive term aT{n/b) does. One term dominates the other when it 
is polynomially larger than the other. Note that for case 3 the the- 
orem is overstated, as the regularity condition af{n/b) < cf{n) for 
some constant c < 1 imphes f{n) = i7(n'°^''""'"'^) for some constant 
e > 0. 

2.2 HausdorfF Dimension 

For background on Hausdorff dimension see [2]. In 1, 2 or 3 dimen- 
sions, we have concept of length, area and volume, respectively, as a 

measure of size of an object. We can obtain this measure by cover- 
ing the object by balls of diameter less than 5 and summing up their 
sizes as defined by diameter raised to power D where an integer, 
is the topological dimension. See Figure 1 (a). 



Hausdorff measure generalizes this to non-integral dimension by 
considering real values of D and examining how the measure would 
change as D varies. 

Example 1. The filled unit square [0, 1]^ has infinite 1-dimensional 
measure (i.e. informally, length) but zero 3-dimensional measure (i.e. 
informally, volume). In fact, when only D = 2 we will get finite 
measure when we sum up sizes of all the 5-balls. For any real D < 2 
we will have infinite measure and for any real D > 2 we will have 
zero measure, thereby indicating that D = 2 is the dimension of 
[0,1]2. See Figure 1 (b) and (c). 

This is true in general when we are trying to measure the size of 
a fractal object. If D is less than the dimension of the object, then 
we should get infinite D-dimensional measure, whereas if D is larger, 
then we should get zero value. 




Fig. 1. Notions of Hausdorff Measure and Hausdorff Dimension. 



Let X be a bounded and closed (compact) subset of metric space 
(M"^, d) where m is a positive integer and d is the Euclidean metric. 
The diameter d{X) is defined by 



d{X) = sup{d{x, y) : x,y E X}. 



Let 5 > 0. A (countable) family {Ajjjgf!} is a 5-cover of X if (\/i)d{Ai) < 
5 and X C (J Ai. For s > 0, define 



HsiX) = inf{^ diAiY : {A} is a 5-cover of X}. 

As 5 decreases, there are fewer 5-covers of X, and therefore Hg is 
non-decreasing and the value 

n'{x) = iimm{x) 

is well defined and may be infinite. 'WiX) is called the s- dimensional 
Hausdorff measure of X. It can be shown that if for some s > 0, 
W{X) is finite then for all t > s, H\X) = 0. There will exist a 
unique real number s > such that 7-{*(X) = oo for t < s and 
li}{X) = for t > s, see Figure 1 (c). This point is called Hausdorff 
dimension of X: 

dimH(X) = inf{s > : = 0}. 

2.3 Iterated Ftinction Systems 

A collection of k contractive transformations Wi : is called 

an iterated function system (IFS) [2]. A contractive transformation w 
brings every pair of points closer by a contractivity factor s < 1. That 
is, d{w{x),w{y)) < sd{x, y). Starting with an arbitrary compact sub- 
set Y C R"* and by applying iteratively these transformations and 
taking their union, 

k 

W{Y) = [jwi{Y) 

i=l 

one can obtain a self-similar fractal object X as the attractor and 
fixed point of W 

X = W{X)= lim W^^\Y). 

In this article, IFS will be non- overlapping as defined in [2]. Intu- 
itively, for any i, j, i ^ j, Wi{X) and Wj{X) do not overlap. They may 



be just-touching at their boundary points though. Fractal dimension 
of X is given by 

dimp(X)=nm^^^^^^ 
.-0 logi 

where A/'(X, e) is smallest number of closed balls of radius e > 
needed to cover X. For non-overlapping IFS, 

dimF(X) = dimH(X) 

and therefore we will use Hausdorff and Fractal dimensions inter- 
changeably. This equivalence allows fast computation of Hausdorff 
dimension of X as the solution of D in 

1=1 

where Sj is the contractivity factor of Wi, see [2]. 

3 Fractal Interpretation of the Recursive Term 
aT{n/b) 

Consider the term aT{n/b) in the recurrence equation. Assume n is 
exact power of b. The problem of size n is divided into a subprob- 
lems each of size n/b. 0(1) computation occurs at the leaf nodes 
of the recursion tree R. R is an a-ary tree of height log^ n and has 
j^iogfctt leaves, sec Figure 2 (a). Computation of aT{n/h) is exactly 
determined by the total number of leaves. 

We build its IFS analog. It is a non-overlapping IFS whose at- 
tractor X is composed of union of its a smaller copies obtained by 
applying a many transformations each of contractivity factor 1/6 

a 

X^{jwi{X)^W{X) 

i=l 

From Equation (1), the Hausdorff dimension of X is given by solution 
of D in 

E(i/&)^ = 1 

1=1 




Fig. 2. Recursion tree for tlie recurrence term aT{n/b). Iterations of IFS correspond 
to tiie recursions of the divide-and-conquer algoritlim. 



which gives dimH(X) = log;, a. Starting with some set Y of diameter 
1, an iteration of W creates a smaller copies of the previous set 
as shown in Figure 2 (b). After log;,n iterations, we have the set 
Y' = which can be covered by J\f{Y',l/n) many balls 

of radius 1/n. Clearly, there will be as many such balls as the leaves 
on the recursion tree R of the recurrence: 

X(Y', 1/n) = T(n) = = ©(n^^'^^^^)). (2) 

Since we want the IFS to be non-overlapping, one has to show 
that such an IFS will exist. Consider the unit cube [0, 1]"^ C W". It 
can be partitioned into 6™ many non-overlapping sub cubes each of 
side length 1/6. Just choose m large enough so that a < b"^. Choose a 
of these subcubes which will then determine Wj's of the IFS mapping 
[0, 1]™ to these subcubes. To see why Equation (2) is true, compute 
B{X,l/ri) which is number of subcubes (boxes) intersecting X in 
the box-counting algorithm to compute dimp(X). The box-counting 
theorem, see [2], states that 

Af{X, l/n)^0{B{X, 1/n)). 

Example 2. See Figure 3 for examples of fractal interpretation of 
recurrence term of the form aT{n/2). The IFS which generate these 
fractal images use contractive quadrant affine transformations. These 
affine transformations are illustrated by showing how they map the 
unit square [0, 1]^ to quadrants. For sake of completeness, here are 
the transformations: 

wi{x,y) = {0.5x,0.5y) 
W2{x, y) = (0.5x + 0.5, 0.5y) 
W3{x, y) = (0.5x, 0.5y + 0.5) 
^4(0;, y) = (0.5a; + 0.5, 0.5y + 0.5) 
w^lx, y) = {O.bx + 0.25, Q.by + 0.5) 

4 Fractal Interpretation of the Overhead Term 

/(") 

The second term f{n) in the recurrence denotes the time taken to 
subdivide the problem and to combine the results of subproblems. 



T(n)= T(n/2) T(n)=2 T(n/2) T(n)=3 T{n/2) T(n)=4 T{n/2) 



dimH(X)=0 dimH(X)=l 
{wi} {W1W3} 



t/=[0,l] 









W2{U) 





dimH(X)=log23 
{Wi,W2,W5} 



dimH(X)=2 
{Wi,W2,W3,W4} 



Contractive affine 
transformations w,'s 
used in IFSs to 
generate images 



Fig. 3. Geometrical interpretation of tlie recurrence term of tiie form aT(n/2), wliere 
a € {1, 2, 3, 4}. The images liave Hausdorff dimensions of 0,l,log2 3 and 4, respectively. 
The IFS which generate these images are also shown. 



Our trick is to consider /(n) as another fractal image C of dimension 
p if /(n) = 0{nP). The IFS is generahzed as follows: 

W{Y) = {[jw,{Y))[jC 

i=l 

that is, we add C at each iteration of the IFS. Such an IFS is also 
referred to as Condensation IFS, see [2]. 
After = logj, n iterations, we have 

Y' = W^^\Y) U C U W{C) U W^^\C) U...U w^^-^\c). 

If Y and C are of diameter 1, then it follows from the definition 
of C that 

and from the definition of W that 

Af{W^^-'\C), 1/n) = a^f{n/b>). 
This and Equation (2) imply 

logfc n-1 

= 6>(n^°S6»)+ ^ a' f{n/b>) ^ T{n). (3) 

Example 3. Consider the recurrence where f{n) is linear function: 

T{n) =T{n/2) + 0{n). 

Let C be a fractal image with dimH(C) = 1. As we saw in the previ- 
ous section, the first term T{n/2) corresponds to an IFS with single 
transformation w of contractivity factor 1/2. For our illustration, we 
choose 

w{x,y) = (0.5a;, O.Sy) 

and C to be a tree like image as shown in Figure 4 and standing 
at point (1,0). Choose Y — C. We show first 3 iterations of the 
condensation IFS in Figure 4. 




Fig. 4. First 3 iterations of the condensation IPS modeling the recurrence T{n) = 
T{n/2) + 0{n). C is a tree-like image with dimH(C) = 1 and models the /(n) = 0{n) 
term. In this example, all computation is dominated by ,f{n) term. 



5 Fractal Interpretation of the Complete 
Recurrence 

To complete the relationship of the recurrence with Fractal Geome- 
try, we will need a result about Hausdorff dimension of attractors of 
Condensation IFS by Mauldin and Williams [7]. 

The theorem of Mauldin and Williams applies to more general 
IFS, referred to as graph directed IFS. In the case of condensation 
IFS, the graph consists of two nodes u and v. Node v represents 
the IFS for the term aT{n/h) and its attractor has dimension 

= log(,a as described in Section 3. The node u represents the 
condensation image C of dimension Du = p , for the term /(n), as 
described in Section 4. There are a edges from v to itself labeled by 
transformations Wi,i G {1,2, ... ,a}. There is one edge from u to v 
labeled by identity transformation. See Figure 5. 

Mauldin- Williams theorem has the following corollary. 

Theorem 1. Consider the condensation IFS in Figure 5. 

1. The Hausdorff Dimension of the attractor X of the condensation 
IFS is D = ma.x{D^, Dy). 

2. Hausdorff D- dimensional measure of the attractor X of the con- 
densation IFS is infinite iff = Du- 



Tin) = a Tin/b) 



f(n)=e{rf) 



o 



identity 




dimH(C)=;? 



dimH(Xv)=log/,a 



dimH(X)=maxQ!7, log/, a) 



Fig. 5. Condensation IFS shown as a graph directed IPS. The IPS models the recur- 
rence T{n) = aT{n/b) + f{n). 

For rigorous proof, see [7] . We provide some intuition behind the 
Theorem. Since 



which holds for countable unions too, the first result follows. For the 
second result, it can be shown that X is union of countably infinite 
number of fractal images, all of same dimension D and same size so 
that the sum of their sizes does not converge and is infinite. 

Mauldin- Williams theorem gives us the link between Fractal Ge- 
ometry and Case 1 and Case 3 of the Master Theorem in which 
dimension of one image dominates the other. Just set e = \Dy — Du\- 
For Case 2, when the dimensions are equal, it gives further insight 
into Hausdorff measure of the underlying fractal image. 

We can now state our main result. 

Theorem 2. LetTiji) = qT{n/b) + f{n) be a recurrence of a divide- 
and-conquer algorithm as in the Master Theorem. There exists a 
non- overlapping condensation IFS with q many transformations, each 
of contractive factor 1/b, whose iterations correspond to the execu- 
tion of the algorithm. Let Hausdorff dimension of the attractor of 



dimH(v4 U B) = max{dimH(v4), dimH(5)} 



the IFS be D. If Haus dor ff D -dimensional measure of the attractor 
is finite, then the solution of the recurrence is T{n) = 0{n^), else it 
is T{n) = 0{n^ log n) . 

The Theorem follows from Equation (3) which leads to the proof 
of Master Theorem in [3] and from Mauldin- Williams Theorem. 

f 

i 

iJ 

1/8 1/4 1/2 1 



Fig. 6. Illustration of geometrical interpretation of Fast Fourier Transform recurrence 
T{n) = 2T{n/2) + e(n). 

Example 4- Consider the recurrence as in Fast Fourier Transform: 

T{n) = 2T{n/2) + 0{n). 

Choose the affine transformations of the IFS to be Wi and as 
shown in Figure 3 and in Example 2, and C to be a vertical line 
segment at point (1,0) as shown in Figure 6. 

Here Du = Dy = 1, so 1-dimensional Hausdorff measure is infi- 
nite. This is obvious from the fact that the image in Figure 6 has 
infinite total length. From Theorem 2, the solution of the recurrence 
is T{n) = 0{nlogn). 

Example 5. Consider the recurrence 



T(n) = 2T{n/2) + 0{n^). 



Refer to Figure 4. Visualize it in 3-D with the third z dimension out 
of the page, and the tree-hke image C replaced by an image with 
dimension 2 e.g. a filled square, which is parallel to the y2;-plane 
and intersects a;|/-planc at x = 1. We have Du = 2 and = 1. 
The dimension of the attractor of the condensation IFS is 2. The 
2-dimensional measure is finite as the total area of the attractor is 
finite. Prom Theorem 2, T(n) = ©(n^). 

Example 6. Consider the recurrence 

T{n) ^ AT{n/2) + e{n^). 

Refer to Figure 6. Visualize it in 3-D with the third dimension out of 
the page, and the vertical line segment C replaced by an image with 
dimension 2 e.g. a filled square, like in Example 5. We have — 2 
and Dy = 2. The dimension of the attractor of the condensation IFS 
is 2. The 2-dimensional measure is infinite as the total area of the 
attractor is infinite. From Theorem 2, solution is T(n) = ©(n^ logn). 

6 Conclusions 

We provided geometrical interpretation of the Master Theorem to 
solve divide-and-conquer recurrences. It is natural to see the connec- 
tion between the exponent D in the time complexity T(n) = 0{n^) 
of such an algorithm and the Hausdorff dimension of an underlying 
fractal image. Another connection can be also seen. The observation 

has its fractal analog in 

dimH(A U S) = max{dimH(^), dimH(-B)}. 

As a final remark, the results of this paper would hold for IFS in 
other metric spaces, e.g. in code metric space S'^ of strings over a 
finite alphabet E — {0, 1, . . . , r}. 
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